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This paper extends and applies the strategies recently developed by the 
authors for handling constraints under uncertainty to robust design opti- 
mization. For the scope of this paper, robust optimization is a methodology 
aimed at problems for which some parameters are uncertain and are only 
known to belong to some uncertainty set. This set can be described by 
either a deterministic or a probabilistic model. In the methodology devel- 
oped herein, optimization-based strategies are used to bound the constraint 
violation region using hyper-spheres and hyper-rectangles. By comparing 
the resulting bounding sets with any given uncertainty model, it can be 
determined whether the constraints are satisfied for all members of the 
uncertainty model (i.e., constraints are feasible) or not (i.e., constraints 
are infeasible). If constraints are infeasible and a probabilistic uncertainty 
model is available, upper bounds to the probability of constraint violation 
can be efficiently calculated. The tools developed enable approximating not 
only the set of designs that make the constraints feasible but also, when 
required, the set of designs for which the probability of constraint violation 
is below a prescribed admissible value. When constraint feasibility is pos- 
sible, several design criteria can be used to shape the uncertainty model 
of performance metrics of interest. Worst-case, least-second- moment, and 
reliability-based design criteria are considered herein. Since the problem 
formulation is generic and the tools derived only require standard opti- 
mization algorithms for their implementation, these strategies are easily 
applicable to a broad range of engineering problems. 
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I. Introduction 


Design under uncertainty arises in numerous disciplines including engineering, economics, 
finance, and management. Achieving balance between robustness and performance is one of 
the fundamental challenges faced by scientists and engineers. Trade-offs should be made to 
meet acceptable levels of performance with adequate robustness to uncertainty. 

The concern in this paper is the analysis and design of a system described by a para- 
metric mathematical model. The parameters which specify the system are grouped into two 
categories: uncertain parameters, which are denoted by the vector p, and design parameters, 
which are denoted by the vector d. For example, one component of d could be the designer’s 
choice for the thickness of a structural member while one component of p could represent the 
manufacturing error in that same thickness or uncertainty in some material property. For 
purposes of using the design techniques presented here, the necessary information about the 
system being designed is abstracted in constraint functions and a performance metric. These 
are functions of p and d. The constraint functions are scaled so that they take on positive 
values at parameter values representing unacceptable systems. The design process attempts 
to find a design which is acceptable over the entire range of uncertainty and which optimizes 
(in a sense to be made precise subsequently) the performance metric. The uncertainty in 
p is modeled by specifying a set, the so-called uncertainty set A p . While the actual value 
of p is uncertain, it is assumed that p G A p . One way of specifying A p will be termed 
“deterministic” . For example, the uncertain manufacturing error mentioned earlier could be 
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modeled as an interval of real numbers based on known manufacturing tolerances. Another 
way of specifying uncertainty is to model p as a random vector. Then A p could be taken 
as the Support Set of its joint Probability Density Function (PDF), so P[p qL A p ] = 0 (if 
f p {p) is the joint PDF of p, take A p = {p : f p (p) ^ 0}). Hereafter, the terms “uncertainty 
set” and “support set” will be considered equivalent. In principle, the uncertainty set can 
be unbounded. In practical applications, the choice of A p is usually made by a discipline 
expert. However, the theory presented subsequently acknowledges that such a choice may be 
fairly arbitrary, and addresses the need for quantifying the level of tolerance of the system 
to uncertainty in p when a particular d is chosen. Any member of the uncertainty set is 
called a Realization. For all the variables that depend on p, such as performance metrics 
and constraints, there is a corresponding uncertainty model. The uncertainty model of these 
variables is fully prescribed by the uncertainty model of p and by the equation that relates 
the dependent variable with p. 

Design requirements for the system are prescribed by means of a vector of constraint 
functions, g(p, d ) < 0, which in general depend on both the uncertain and design parameters. 
The system is deemed acceptable if the constraints are satisfied for all possible realizations 
of the uncertain parameter. For each value of the design parameter vector, these functions 
partition the uncertain parameter space into two sets, a Failure Domain, where the design 
requirements are not satisfied because at least one of the constraints is violated, and its 
complement set, the non-failure domain where no constraints are violated. 

For a fixed design point d and a given uncertainty model of p, the constraints g(p , d) < 0 
are said to be Feasible , if they are satisfied for all possible realizations of the uncertain 
parameter. Otherwise, the constraints are Infeasible. Robust optimization strategies can 
be classified according to the ability and/or desire to make constraints feasible. Constraint 
feasibility is usually imposed on critical design requirements. Previous strategies 1-5 to solve 
the resulting semi-infinite optimization problem require nested searches to identify the Worst- 
Case Parameter Realization. 1 In previous work, 6 ’' we present constraint feasibility tests 
based on the deformation of sets in p-space and the calculation of Critical Parameter Values 
(CP Vs) and Parametric Safety Margins (PSMs). These methods are optimization based, 
and the results are reliable so long as global optima have been obtained. 

By necessity or desire, one may want to let some parameter realizations violate the 
constraints. This situation may result from slack design requirements, overly large uncer- 
tainty sets and limiting design architectures. Deterministic 5 and probabilistic 8-11 approaches, 
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including chance-constrained programming , 12 sampling-based techniques, reliability-based 
methods , 13 and penalty-based optimization , 5,12 are available. The developments in prior 
work 14, 15 use probabilistic uncertainty models and focus on strategies for limiting the proba- 
bility that p will fall into the Failure Domain. Hereafter, the probability that the uncertain 
parameter falls in the Failure Domain will be referred to as the failure probability. In these 
studies , 8-11 closed-form expressions for upper bounds to the failure probability are derived 
along with a hybrid method for the approximation of its actual value. Analogous to con- 
straint feasibility tests in the previous work , 6, 7 this optimization-based methodology is based 
on the deformation of sets, now in the standard normal space, and on the calculation of CPVs 
and Reliability Indices (RIs). 

In this paper, the deformations mentioned above are expansions or contractions that 
preserve proportionality and orientation. These are called homothetic deformations. The 
methods developed in the prior work 6,7,14,15 are based on the homothetic deformation of 
hyper-spherical or hyper-rectangular sets until the deformed set is of maximal size without 
encroaching on the Failure Domain. For these two geometries, we cast the problem of hireling 
the maximal homothetic deformation in terms of an optimization problem for which standard 
nonlinear constrained optimization algorithms are applicable. Because the Failure Domain 
depends upon the design variable, the larger the maximal homothetic deformation, the better 
the robustness characteristics of the corresponding design. Therefore, one can then search 
for a design which admits the largest maximal homothetic deformation. Design optimization 
methods based on this idea are presented herein. 

When there are designs for which the constraints are feasible, we can attempt to select 
one of these designs which optimizes the value of a performance function y(p,d). However, 
since p can be any point in the uncertainty set, y can take on many values for each feasible 
design; these values comprise the uncertainty model of y at the design point. Several design 
criteria, in the form of functionals J which operate on these uncertainty models, will be 
introduced to provide a single value of merit from this collection of possible performance 
function values. The design criteria considered in this paper are worst-case, least-second- 
moment and reliability-based. The robust constrained optimization problem of interest will 
lead to designs for which the uncertainty model of y is optimal while the constraints remain 
feasible. 

The content of this paper is organized as follows. The problem formulation and basic 
mathematical background is described in Section II. An overview on how to study and 
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integrate inequality constraints into robust optimization problems is presented in Section 
III. The optimal design criteria mentioned above are then introduced in Section IV and 
exemplified with a low-dimensional example in Section V. Finally, Section VI presents 
conclusions. 


II. Problem Formulation 

A design procedure using a conventional constrained optimization problem with no un- 
certainty wherein it is assumed that the parameter p is equal to a known value p is given 
by the following problem statement: 

Problem 1 (Deterministic Optimization Problem). 

min {y(p, d) :g(p,d) < 0} 

a 

Here, y is a performance metric of interest and g is a set of constraint functions for 
which the inequalities g < 0 correspond to a set of requirements for which violations are 
unacceptable. The cases in which some violations are acceptable or even unavoidable are 
considered later (Section IV. A. 3 and Section IV. B, respectively). Now we consider the case 
in which p is uncertain and we have modeled the uncertainty with an uncertainty set A p . 
For a given design point, the propagation of A p through y leads to the uncertainty set 
A y {d) = y(A p ,d). In this case, the counterpart to Problem 1 is given in the following 
problem statement: 

Problem 2 (Robust Optimization Problem). 

min { J (A y (d)) : g(p,d) <0 for all p G A p } 

d 

Here, </(•) assigns a scalar to each uncertainty model A y (d). For example, to minimize 
the worst case value of y, J( A y ) would be chosen to be max(A y ). Observe that Problem 
1 is the special case of Problem 2 with A p = {p} and J being (essentially) the identity 
function. If p is modeled as a random vector and A p is the support of its PDF, any design 
d which satisfies the constraint g(p, d) < 0 for all p G A p in Problem 2 has zero probability 
of violating the constraints. 

The robust optimization problems above deal with the search for design points that shape 
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the uncertainty model A y of y, directly in the deterministic case and indirectly by shaping 
f y (y) in the probabilistic one, according to the optimality criterion prescribed by J, while 
limiting the search to designs d for which no vector in the set g( A p , d ) has any positive 
components. For instance, in a structural problem p could contain material properties, d 
might parameterize the geometry of the structure, and g < 0 might be a requirement on 
the maximum allowable stress. If y is the weight of the structure, whose dependence on p 
makes it uncertain as well, J(y) might be the worst-case weight. 

III. Robustness Analysis 

The tools introduced in this section enable the quantification of the robustness of the 
system and provide the means to efficiently implement a constraint feasibility test in the 
form of a constraint function for an optimization problem and to calculate upper bounds of 
failure probability. 

In an earlier paper,' we introduced the notions of a Reference Set Q p in p-space and a 
distinguished realization of the uncertain parameter, p € D p , called the Designated Point , 
which can be regarded as the nominal value of the uncertain parameter. For clarity sake, 
the presentation of the material will concentrate on the case where the Designated Point 
is feasible; i.e., gip. d) < 0. By consideration of maximal homothetic deformations of the 
Reference Set which did not intersect the Failure Domain (which is a function of the chosen 
design), a measure of the robustness of that design to parameter uncertainty was obtained. 
One reasonable choice for the Reference Set is a hyper-sphere. The hyper-sphere of radius 
R centered at p, denoted as S(p, R ), is defined by 

S{p,R) = {p ■ \\p-p\\ < R}, 

where || • || denotes the £ 2 norm in K dim (p) space. Another reasonable choice might be 
to confine each component of the Reference Set to a bounded interval. This leads to a 
hyper-rectangular set. If m is the vector of half-lengths of the sides of the rectangle, the 
hyper-rectangle 7 Z(p, m) is defined by 

R(p, m) = {p: p t e \pi - m.J, + mj, 1 < i < dirn(p)} . 

Hyper-spherical sets consider parameters with similar levels of uncertainty. They could also 
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be used for parameters with dissimilar levels of uncertainty if some scaling is used. However, 
whether scaling is used or not, a degree of dependence is introduced. For instance, the range 
of variability of one parameter depends on the values taken on by the others. Rectangular 
sets permit the consideration of dissimilar levels of uncertainty without the need for scaling 
and introduce no such dependence. A design point is deemed to be in the Feasible Design 
Space (FDS) if it satisfies all the constraints when the uncertain parameter assumes the 
value of the Designated Point. A design is a Robust Design if it is a feasible design for every 
choice of the uncertain parameter in the uncertainty set. The Robust Design Space (RDS) 
is the set of all Robust Designs. Note that if the RDS exists, it is a subset of the FDS. This 
is so since the implied constraint set {p} for p in Problem 1 is a subset of the constraint 
set in Problem 2. For a fixed design point d, the Failure Region , denoted as lF(d,g), is 
composed of the parameters that do not satisfy all the constraints, and is given by the union 
of the Failure Domains for each individual constraint J-i(d,g) = {p : p, (p, d) >0}, where 
i — 1 , . . . dirn(p). 

One of the tasks of interest is to assign a measure of robustness to a design point based on 
measuring how much the Reference Set can be deformed before intersecting the Failure Do- 
main. Mathematical structure is imposed on this process by limiting attention to homothetic 
deformations. A Homothetic Deformation by a factor of a can be viewed in the following 
way. Imagine standing at the Designated Point and looking at any other point of D p . Denote 
the distance from the Designated Point to the other point by 5. The corresponding point of 
the Homothetic Deformation of D p with similitude ratio a is attained by looking in the same 
direction and placing the point at a distance of a5 from the Designated Point. A mathe- 
matical expression for the corresponding deformed set is {q : q = p + a (p — p),p G D p }. 
While expansions are accomplished when a > 1, contractions result when a < 1. Hereafter, 
deformations must be interpreted as homothetic expansions or contractions. 

For purposes of this paper, two uncertainty models will be called Proportional if one 
of the two sets can be formed from the other by homothetic deformation by some positive 
factor about the common Designated Point. Such a factor is called the Similitude Ratio and 
is denoted by a. For instance, the hyper-rectangles 7 Z(p, m) and 7Z(p, am) are proportional 
sets. 

The notions of Critical Parameter Value and Parametric Safety Margin are now intro- 
duced. The reader should keep in mind that these are functions of the design point, since 
they depend on the Failure Domain which, itself, depends on the design point. Intuitively, 
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one imagines that a set proportional to the Reference Set is being expanded homotheticly 
with respect to its Designated Point, until its boundary just touches the boundary of the 
Failure Domain. The point (s) where the expanding set touches the Failure Domain is (are) 
the CPV(s). The Critical Similitude Ratio (CSR), denoted as a, is the similitude ratio of 
that expansion, and the PSM, which will be defined subsequently for the cases that the 
Reference Set is a hyper-sphere or a hyper-rectangle, is a dimensional metric that quantifies 
the size of the corresponding deformed set. Both the CSR and the PSM are measures of 
robustness of a design to parameter uncertainty. The larger these metrics are, the larger 
the variation of the uncertain parameter from the Designated Point that can occur before 
encountering a constraint violation. Therefore, both are metrics which quantify the degree 
of robustness of d to uncertainty in p. 

The CSR is non-dimensional, but depends on both the shape and the size of the Reference 
Set. The PSM has the same units as the uncertain parameters, and depends on the shape, 
but not the size of the Reference Set. If the PSM assumes the value of zero, there is no 
robustness since at least one of the constraints is active for p. The convention is that designs 
within the FDS assume non-negative PSM values, otherwise they are negative. 

In the case that the Designated Point p satisfies the constraints (g(p, d) < 0 ) for a given 
design point d, the Spherical PSM, denoted as p$, is the distance from p to a CPV p , which is 
a point on the boundary of the Failure Domain which is closest to the Designated Point. By 
viewing this as homotheticly deforming the hyper-spherical Reference Set Q p = S(p , R ) until 
it touches the constraint violation region, finding p can be cast in terms of an optimization: 

p = p M , (1) 


where 

i— argmin { ||p^ — p\\ } , (2) 

l<j<dim(g) 


and 

p( j ) — ar g m j n | ||p _ p|| ; g^p, d) > 0} . (3) 

p 

(Recall that the mathematical operator “min” returns the minimum value of a function or 
set, while “argmin” returns the value of a variable at which that minimum occurs.) 

In the event that some constraint is violated at p , CPVs are redefined as points in or on 
the boundary of the constraint satisfaction set which are closest to the Designated Point. 
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Such a CPV can be calculated using the previous procedure by reversing the inequality in 
the optimization given in (3). The fact that, for this design, the Designated Point is in the 
failure domain is signaled by defining the Spherical PSM to be a negative quantity. The 
Spherical PSM is now defined as: 

a / ||p-p|| for g(p,d) <0 

Ps = < _ (4) 

1 ~~ ||p — Pll Otherwise 

In contrast, in the case that the Designated Point satisfies the constraints at a given design 
point, the homothetic deformation of the hyper-rectangular Reference Set Q p = 7 Z(p, m) 
leads to the CPV and CSR given by 

p = p^ and a = a^\ (5) 


where 


and 


i= argmin {||p W - f>||“} , 

l<7<dim(g) 


(p (j \ a^) = argmin{a : gAp , d) > 0, \p k — p k \ < am k , 1 < k < clim(p)}, 

p,a 


( 6 ) 

(7) 


and where the m-scaled infinity norm is defined as ||*||^, = supjda^l/mj}. As in the 
Spherical case, if the Designated Point does not satisfy the constraints, the CPV and CSR 
are calculated by reversing the first inequality in (7). The corresponding Rectangular PSM, 
denoted as p r, is defined to be: 


a I a||m|| for g(p, d) < 0 

Pr= { ( 8 ) 

J — cf || m || otherwise 

Details on the derivation of these expressions are available in an earlier paper.' Figure 1 
shows a sketch with relevant metrics for a rectangular Reference Set. 

For a given design point and Reference Set, the set proportional to the Reference Set that 
has the CPV(s) on its boundary is called the Maximal Feasible Homothet and it is denoted 
as M. p or, if the dependence on d is important, M. p {d). The title of this paper refers to 
the fact that when the constraints are satisfied at the Designated Point, the complement set 


9 of 25 


American Institute of Aeronautics and Astronautics 




M. c of Ai p bounds the Failure Domain. On the other hand, when the constraints are not 
satisfied at the Designated Point, the complement of A4 P bounds the non-failure domain. 

The notions and metrics introduced above do not require probabilistic uncertainty mod- 
els. Since uncertainty models can be probabilistic in nature, one may wonder how to integrate 
such models with the above developments. Recall that when constraints are feasible, the 
failure probability is equal to zero. When the complement set of Ai p bounds the Failure 
Domain, an upper bound to the failure probability can be easily calculated. This bound is 
given by 

tV = 1 - P[M r \ = P[M%, (9) 

where P[-] is the probability operator. If the components of p are independent random 
variables and D p is the hyper-rectangle 7Z(p,m), Equation (9) leads to 

dim(p) 

= 1 - n 
2=1 

where F p (p) is the Cumulative Distribution Function (CDF) of p t . Note that there is an 
upper bound for each non-proportional Reference Set. While the bound corresponding to 
D p = lZ(p ( ' 1 \ ami 1 )) i s independent of a, the bounds that result from finding the Maximal 


F p, Pi + 


PRfrti 


\m\ 


Pi 


Pnm 2 


\m\ 


( 10 ) 
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Feasible Homothets of 7 Z(p l ' 1 \ m^) , 1Z(p( 2 \m^), and 7 can all be different. 
The main advantage of using Equation (9) is that failure probability bounds corresponding 
to new probabilistic uncertainty models are trivial to evaluate since they do not require 
solving for A4 P again. As compared to methods based on the transformation of the problem 
to standard normal space, this bound not only avoids the numerical error generated by 
the transformation (which ranges from considerable to unmanageable as failure probabilities 
become smaller) but also greatly reduces most of the dependence of the calculations on the 
uncertainty model assumed. It should be noted that, using Equation (9) also has a downside. 
Since the p-deformation needed to size M. p does not use the probabilistic uncertainty model, 
the upper bound i/j p might be large. Better bounds in Equation (9) are obtained if P[_M p ] 
can be increased by variation of the geometry of the Reference Set. Strategies for this are 
considered in Section IV. B. 


IV. Constraint Feasibility 

It is necessary to find an algorithmic tool to implement the constraint feasibility condition 

g(p, d) < 0 for all p G A p 

in Problem 2. Determining constraint feasibility is not a simple task since there are an 
infinite number of parameter realizations for which the constraints must be satisfied. Since 
the numerical search for a solution to the robust optimization problem requires repeated 
determination of constraint feasibility, the test must also be efficient. For use in standard 
constrained optimization software, this test should be in the form of an inequality constraint. 
Tools commonly used for uncertainty analysis and design, such as Monte Carlo Sampling 
(MCS) and the First Order Reliability Method (FORM), 13 are not well-suited to determine 
constraint feasibility. More importantly, they are ineffective and inconclusive when dealing 
with cases where constraints are feasible. In this case, with all points in the Uncertainty 
Set being feasible, the optimization used in FORM diverges since, in standard normal space, 
the limit state function has no level curves at the zero level; while the error due to finite 
sample size in the MCS estimate of the probability of constraint violation might wrongly 
indicate constraint feasibility. Since Problem 2 precisely targets design points at which there 
are no constraint violations, and therefore these numerical tools break down, the need for 
constraint feasibility tests is apparent. 


11 of 25 


American Institute of Aeronautics and Astronautics 



The means by which the constraints in Problem 2 are to be implemented will be provided 
by a constraint feasibility test. Constraint feasibility tests have been recently proposed 7 by 
the authors. Such tests not only allow determination of constraint feasibility condition for 
hyper-spherical and hyper-rectangular uncertainty sets, but also make Problem 2 computa- 
tionally tractable. 

The constraint feasibility test is based on the comparison of M. p {d) with the uncertainty 
set A p . If the Feasibility Condition A p C 4 p (d) holds, the constraints are feasible, i.e., for 
this fixed d, g(p , d) < 0 for all p G A p . On the other hand, constraints are infeasible if there 
exist a parameter realization for which at least one constraint is violated. For arbitrarily 6 
shaped uncertainty sets, many feasible design points may be captured by using a hyper- 
spherical or a hyper-rectangular set to bound A p , and comparing the size of the bounding 
set with that of the Maximal Feasible Homothet. The constraint condition in Problem 2 
is implemented either exactly (if A p is a hyper-sphere or hyper- rectangle) or conservatively 
(if A p must be bounded by a hyper-sphere or hyper- rectangle). The feasibility condition 
is realized as an inequality constraint by comparing the sizes of the uncertainty set (or 
its bound) with the Maximal Feasible Homothet; e.g. if R is the radius of the bounding 
set, pn(d) is the Spherical PSM of the Maximal Feasible Homothet, and pn(d) > R, the 
constraints are feasible for this d. 

The design space can be explored by determining if A p C M. p (d) as d varies. If a design 
point for which A p C A4 p (d) is found, a solution to Problem 2 exists. The set of designs 
for which this is attained is exactly the RDS if the uncertainty set is hyper-spherical or 
hyper-rectangular, and is a conservative approximation to the RDS if the uncertainty set 
must be bounded by a hyper-sphere or hyper- rectangle. The design point for which the 
PSM is maximal is called the Robustness Driven Design. For this design, the corresponding 
Maximal Feasible Homothet is the largest. If constraints are infeasible for all design points, 
say because the CPV corresponding to the Robustness Driven Design is an interior point of 
A p , a solution to Problem 2 does not exist. 

IV. A. Optimality Criteria 

In this section, it is assumed that constraints are feasible for at least one design point. 
Therefore, a solution to Problem 2 exists. A few candidates for the design criterion functional 
J for use in Problem 2 are introduced next. Recall that once the uncertainty set A p and the 
performance function y are fixed, the uncertainty set A y (d) = y( A p , d) is determined by the 
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design parameter d, and so the value of J acting on that uncertainty set is determined by 
d. Thus, solving Problem 2 can be considered to be optimizing J(d) over the set of feasible 
designs d. 


IV.A.l. Worst- Case 

This criterion is to be used when we want to minimize the worst-case performance value. 
The corresponding cost functional is given by 

J\vc = y{p*,d)i (11) 


where 


p* = argmax{y : p e A p } (12) 

p 

is the Worst- Case Parameter Realization. In the above equation is assumed that the smaller 
the value of y the better the corresponding design. If the opposite holds, use the argminj-} 
operator in Equation (12). In general, the Worst-Case Parameter Realization depends on 
the design variable and might not correspond to the parameter realizations that are the 
furthest from the Designated Point. Therefore, the search for an optimal design in the 
worst-case sense requires solving a min-max problem. Obviously, the implementation of this 
criterion requires that A y be bounded from above for all the design points within the RDS. 
This requirement imposes restrictions on the structure of y(p, d) within the support set A p . 
Optimal designs corresponding to this criterion provide performance guarantees, since all 
other realizations of y are less or equal than Jwc- However, its use may lead to excessively 
conservative designs since the Worst-Case Parameter Realization might be extreme and very 
unlikely. Strategies to identify 1 and approximate 16, 17 this realization are available. Since the 
implementation of this criterion only requires prescribing the support set of the uncertain 
parameter, probabilistic uncertainty models are redundant. 


IV. A. 2. Least- Second- Moment 

The implementation of this criterion requires a probabilistic uncertainty model. This crite- 
rion is to be used when we want to concentrate all possible performance values as close as 
possible to a target value. We might want this to improve performance reproducibility or to 
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reduce its variability. The corresponding cost functional is given by 

Jlsm = V[y] + E [y] (E [y] - 2 y) + y 2 , (13) 

where E[-] and V[-] are the expected value and the variance operators respectively and y is 
a target value. Equation (13) results from calculating the second moment of the random 
performance metric about the target value. By minimizing Jlsm in Problem 2, we are 
searching for a design point that maximizes the concentration of y about y, i.e. in an ideal 
case, the optimal design leads to f y (y ) = S(y — y), where £(•) is the Dirac delta. The 
minimization of the variability of y can be obtained from Equation (13) by substituting E[y] 
for y. This is not quite a special case, since in general E [y\ is a function of d, and y is not. 

IV. A. 3. Reliability-based 

As before, the implementation of this criterion requires a probabilistic uncertainty model. 
This criterion is to be used when we want the performance to stay within a prescribed 
admissible range. The corresponding cost functional is given by 

Jre 1 = P[(y <y)U(y> y)] + h(y, y ), (14) 

where y and y are the minimum and maximum allowable performance values respectively, 
and h is a penalty function. The variables y, y, and the function h are prescribed in advance. 
Equation (14) allows for using shapable Failure Domains by augmenting the set of design 
variables. See the authors’ prior work 11 for details. Thanks to the first term in Equation 
(14), the probability of attaining performance values within the non-failure domain y < 
y < y is maximized. The last term can be used to enhance the resulting performance by 
simultaneously reducing y — y. For instance, if y is the weight of the structure, assuming 
y = 0, and y = e, implies that the admissible weight range is [0, e] . By using Equation 
(14) with h(e) = e/y max for e > 0, and making e an additional design variable in Problem 
2, the size of the admissible weight range is reduced while the probability of y exceeding e 
is simultaneously minimized. The parameter y max is chosen by the designer to balance the 
influence of the two terms in Equation (14). 

Note that violations to the requirements g < 0 were regarded as unacceptable, i.e., 
these constraints are “hard”. Violations to y < y < y in Equation (14) are allowed; so 
these constraints, which are built into the design criterion functional J, are “soft”. This 
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distinction must be taken into account when deciding in which of these two formats a given 
requirement should be cast. 

The numerical tools available for the estimation of failure probabilities might be inaccu- 
rate (e.g. FORM for a large failure probability), computationally expensive (e.g. sampling 
for a small failure probability) or unsuitable for gradient-based design optimization (e.g. the 
estimation of J RE via sampling leads to a piecewise constant function of d). The upper 
bounds in Equation (9) provide an alternative way to enforce the reliability-based design 
criterion. There are several advantages to using upper bounds in an optimization driven 
design procedure, instead of using the available estimates of failure probability. 

(a) The calculation of the upper bound is relatively cheap compared to estimating failure 

probability by Monte Carlo sampling. 

(b) The upper bound is a true conservative overestimate of the failure probability, while 

there is no way of knowing whether estimates of failure probability by FORM or Monte 
Carlo underestimate or overestimate the value. 

(c) The accuracy of the upper bound does not depend on the value of the failure probability, 

while the accuracy of both FORM and Monte Carlo sampling with a fixed number of 
sample points is very sensitive to the actual value of the failure probability. 

(d) These bounds are smooth functions of the design variable, whereas a Monte Carlo 

estimate of failure probability using a fixed sample is a piecewise constant function of 
the design variable with step discontinuities as changing the design variable makes the 
failure boundary move across any of the sample points. 

Using the bounds, Equation (14) is replaced by 

Jre 2 = ^ P + h{y,y), (15) 

where ip p results from using Equation (9) along with the constraint function g = [y — y,y — 
y] < 0 . Note that J REl < Jre 2 - 

IV. B. Infeasible Constraints 

This section considers the case when one or several of the constraints in g are infeasible. 
If the design requirements can not be relaxed (i.e. the way in which g depends on p is 

15 of 25 


American Institute of Aeronautics and Astronautics 



fixed), and the uncertainty model cannot be refined, the corresponding requirements must be 
enforced as soft constraints. This practice implies that (some, presumably limited) constraint 
violations are now acceptable. One may decide to only use this format after realizing that 
since no uncertainty model is perfect, the value of attaining constraint feasibility is mostly 
mathematical. Strategies for the efficient implementation of the soft constraints are presented 
next. 

The ideas that follow require probabilistic uncertainty models for their implementation. 
Since the requirements corresponding to the constraints in Problem 2 have been regarded 
as important, the performance metric y will now be ignored. The emphasis is now on 
finding a design which is as close to feasible as possible. If the constraint vector is written as 
g = [g,^g f\, where g i has the infeasible constraints and g f has the feasible ones, a reliability- 
based formulation to the problem of interest is 

nun {P\g { ^ 0 ] : g f < 0 , Vp e A p } . (16) 

The inequality g { ^ 0 says that some component of the vector g % is positive which is on the 
failure side of the constraint boundary, so the event represented by [g t ^ 0 ] is the g t failure 
set. 

It was noted earlier that the upper bound on failure probability could be improved 
by changing the geometry of the Reference Set. Another means of looking for improved 
upper bounds is by transforming the uncertain parameters to become random variables with 
different distributions. A commonly used and well studied transformation results in the 
transformed parameters being an independent vector of standard normal random variables, 
denoted by u. The transformation 13 between p-space and rt-space will be denoted as u = 
U(p )■ 

The developments in prior work 14, 15 are based on the homothetic deformation of hyper- 
spheres and hyper-rectangles in rt-space. In that work, ideas parallel to the ones introduced 
in Section III are developed. For instance, analogous to the Spherical PSM is the Spherical 
Reliability Index /3s, and to the Rectangular PSM is the Rectangular Reliability Index (3 r. 
Likewise the CPV and the Maximal Feasible Homothet in p-space are analogous to their 
counterparts in ■u-space. The Reliability indices (RI) are the best measure of robustness 
of a given design for a given uncertainty model providing that such a design is non- robust. 
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Analogous to Equation (9) is the upper bound to the failure probability 

^«=1 -P[M V ] = P[M C ^ (17) 

where A4 U is the Maximal Feasible Homothet resulting from the deformation in ■u-space. 
Note that bounds in Equations (14) and (16) can be calculated using Equation (17) as well. 
In contrast to ^ p , can be calculated analytically for both hyper-spherical and hyper- 
rectangular Reference Sets. Expressions for this can be found in the an earlier paper. 15 The 
unimodal, rotationally symmetric, and exponentially decreasing nature of the PDF in u- 
space allows for placing hyper-spherical and hyper-rectangular Reference Sets so that their 
Maximal Feasible Homothets capture more success domain probability. This practice may 
yield better upper bounds than the ones in Equation (9). However, the calculation of ip u is 
strongly dependent on the uncertainty model assumed. 

Deformations in ■u-space also enable accurate and efficient approximations to the failure 
probability. 15 Note that the bounds p) p and ip u are probabilities of events, so they fall in 
the numerical range of zero to one. The calculation of ipp and ip u enables the approximation 
of the set of designs for which the failure probability is below an admissible value. This 
information greatly facilitates the implementation of design optimization schemes. 


V. Example 


A two-dimensional problem in the design variables, i.e., d = [eR, d 2 \, and in the uncertain 
parameter, i.e., p = [p 1 ,p 2 ] ) has been selected to facilitate visualization of the concepts 
introduced in this paper. The same example has been used in previous work 6 ’'’ 14,15 to 
exemplify other aspects of the methodology. It is assumed that the Designated Point is 
p = [1,1], while the performance metric and the constraint set are 


y = 




(d 2 + 7p 1 



5 


3 d 2 - 4 p\ - 4dip 2 sin (p 2 d l - p\) 

- sin (pjp 2 - sin(2p 1 - 2)) - did 2 p x - p 2 
d 1 + p\d 2 2 - 4 pIpl - 4 sin (2 p x - 2 \p 2 ) 

2(Pi + p 2 ) sin (pj - d 2 ) - 2p 1 p 2 (d 2 + 2 p\ - 2) + d 1 - 6 p 1 
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The PSMs for design points within the FDS corresponding to D p = S(p,R ) are shown in 
Figure 2. In this example, the spherical PSM can be interpreted as the largest percentile 
of variation in p from its nominal value allowed before a constraint is violated. According 
to the figure, parameter variations of less than 53% lead to non-empty RDSs. Therefore, 
the Robustness Driven Design is able to tolerate variations of up to 53% in p. Notice that 
more than one PSM maximum occurs (there are local maxima in the vicinity of [—1, 0] and of 
[—2.2, —2.4]). More importantly, notice that designs further in from the boundary of the FDS 
are not necessarily more robust. For instance, the comparison of d ^ = [—2.25, —2.4] and 
d ^ = [—1, —1] shows that ps(d ^ ) ps(d^) even though d ^ is much closer to a constraint 
limiting the FDS than d (2) . Figure 3 shows the rectangular PSM values for D p = 7 Z(p, [1, 4]). 



Figure 2. Spherical PSM ps(d) in the FDS. 


Considerable differences in the distribution and magnitude of the PSMs, as compared to the 
previous figure, are apparent. This indicates a strong dependence of the robustness on the 
geometry of the Reference Set. Consider the Support Set A p (/i) = lZ(p, p[l, 4]). When p 
assumes the value of zero, the Problems 1 and 2 are identical since there is no uncertainty, 
and all the J s of Section IV. A coincide. The solution to this problem will be referred to 
as the Deterministic Optimal Design. From Figure 4 it can be seen that two constraints 
are active at the Deterministic Optimal Design point. Increasing values of p in A p (/i) will 
now be assumed. For each value of p, it is assumed that p 1 and p 2 are independent random 
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Figure 3. Rectangular PSM Pr(cL) in the FDS. 


variables which have Beta distributions based on /3( 5, 2) and f3( 2, 5), respectively, but shifted 
and scaled to be supported by A p (y). 

For each y value, solutions that minimize the cost functionals in Equations (11-14) are 
calculated. Since the performance function y is non-negative, the best possible performance 
value that any design could attain is zero. By using the worst-case criterion one intends 
to identify the design which minimizes the largest y. By using the least-second-moment 
criterion, one tries to concentrate y near the target y — 0. By assuming y = (max{y} + 
3 min{y})/4, y = — oo and h — y , when using this criterion, one tries to reduce the probability 
that y lies in the upper three-quarters of A y while reducing the value of the number which 
marks the division of the lower quarter and the upper three-quarters of the A y . Note that 
A y , y and h, are functions of the design parameter. The worst-case optimal designs for 
increasing values of y are grouped in a set referred to as the optimal trail in the worst-case 
sense. Optimal trails corresponding to the least-second- moment and the reliability-based 
design criteria are also generated. These three trails are shown in Figure 4. Moving along a 
design trail from the Deterministic Optimal Design to the designs corresponding to increasing 
values of y corresponds to optimizing the corresponding cost functional over increasingly 
larger uncertainty sets. Note that the three trails converge to the Robustness Driven Design 
at y* = 0.26, which is d* = [0.718,0.631]. Recall that the Robustness Driven Design is the 
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one for which the PSM is the largest. In this case the uncertainty set has grown so large 
that the RDS is reduced to a point, therefore all three cost functionals lead to d* . 



Figure 4. Optimal trails. 



Figure 5. Optimal PDFs for (i = 0.1235. 


The PDFs of the optimal performance functions corresponding to fi — 0.1235 are shown 
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in Figure 5. The corresponding support sets are A y = [1.242,57.85] for the worst-case 
criterion, A y = [0,105.63] for the least-second-moment criterion and A y = [0.197,58.81] for 
the reliability-based criterion. Notice that the PDF for the worst-case solution does not 
cover the vicinity of the ideal value of y = 0. This is not the case for the other two solutions. 



-4 -3 -2 -1 0 1 2 3 4 5 


Figure 6. ipp(d) in the FDS for ttp = 7 Z(p, [1,4]). 


In what follows we assume p = 0.26004 in the probabilistic uncertainty model of p 
defined earlier. Since p > p*, at least one constraint is infeasible, the RDS does not exist, 
and P[F\ >0 for all design points. The functions i}) p (d) and 'ipu(d) corresponding to the 
Reference Sets fl p = 77(p, [1,4]), and fl u = 77(0, [1, 1]) are considered next. The bound i/j p 
is shown in Figures 6 and 7. While Figure 6 clearly shows large bound values, Figure 7 is 
used to better illustrate small ones. The resolution used in this figure does not allow to see 
the smallest bound, which is i/j p (d*) = 2.4972 x 1CT 10 . Recall that the calculation of -0 p for 
a different uncertainty model would only require changing the CDF in Equation (10). 

Figures 8 and 9 show 'ipu(d). The contour of the FDS corresponding to ip p (d) is shown 
as a dashed line in Figure 8. The two FDSs are different since the Reference Sets use 
different Designated Points, i.e., p ^ D -1 (0). The smallest ip u (d) bound, which corresponds 
to the design point attaining the largest Rectangular RI, which is f3n = 12.22, is i^ u (d') = 
4$(— 8.6408)<F(8.6408) = 1.1160 x 10 -17 , where $ is the Cumulative Distribution Function 
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Figure 7. — log ('ipp(d)) in the FDS for ttp = 7 Z(p, [1,4]). 



of a standard normal random variable and d) is approximately equal to d*. As before, the 
resolution of the figures prevents us from seeing this value. This bound is so small that the 
evaluation of the equivalent expression 1 — ($(8.6408) — $(— 8.6408)) 2 is approximated with 
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Figure 9. — log ('ipu(d)) in the FDS for f lu = 7^.(0, [1, 1]). 


0 by Matlab®. In general, the designs d* and d) are different. In this example, d) rs d* since 
A p and M. p {d*) = lZ(p, /x* [1,4]) are almost identical. Since the corresponding Reference 
Set is anchored at the origin of -u-space, where most of the probability is, considerably 
smaller bounds are obtained as compared to the ones in Figures 6-7. Recall that for a 
different uncertainty model, and in contrast to -0 p , the calculation of i\) u requires solving a 
new optimization problem to identify the new the Maximal Feasible Homothet. 

There were instances during the calculation of i/j u (d) when the numerical error caused by 
the transformation to rt-space U(p), led to inaccurate results. This occurs when ||m|| 0. 

Due to this numerical anomaly, the rt-space must be artificially bounded when searching for 
the CPV. Failing to impose these bounds may result in the numerical search not converging. 
The usage of such bounds, however, imposes a low numerical limit on the values of i/j u that 
can be calculated. Notice that lower values of 'ip p {d) would have been obtained if we chose 
p = D _1 ( 0) instead. Such practice, however, imposes the need for a probabilistic uncertainty 
model. In the absence of a such a model, a natural choice for the Designated Point is the 
geometric center of the uncertainty set. 
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VI. Concluding Remarks 


Strategies for the analysis and solution to robust optimization problems are proposed 
herein. The methodology developed provides the means to quantify the robustness charac- 
teristics of a given design point according to existing levels of uncertainty. In addition, it 
allows for determining constraint feasibility in a conclusive and computationally tractable 
manner. Strategies to deal with feasible and infeasible constraints are considered. This 
paper implements worst-case, least-second-moment and reliability-based design criteria into 
the robust optimization problem of interest. When the worst-case design criterion is appli- 
cable, performance guarantees are attainable. However, such solutions are usually driven by 
extreme and very unlikely parameter realizations, resulting in designs with excessive con- 
servatism. In contrast, design criteria using probabilistic uncertainty models are able to 
account for the likelihood of all possible outcomes. In this setting, a reliability-based design 
captures the intent of the worst-case criterion since extreme parameter realizations still drive 
the design process. However, the amount of conservatism is considerably reduced since it 
allows for some realizations to fall outside the admissible range of performance. In contrast 
to these two criteria, a least-second-moment design is driven by the most likely events. This 
characteristic is appealing from the practical point of view, esspecially when the resulting 
probability of unfavorable performance is low. Upper bounds to failure probability, based 
on the homothetic deformation of sets in the original uncertain space, were proposed herein. 
Design-optimization schemes based on these bounds have several advantages: the calculation 
of the bounds is comparatively cheap, their usage considerably relaxes the dependence of the 
calculations on the uncertainty model assumed, and their values are guaranteed to bound 
the failure probability from above. 
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